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ABSTRACT 

This paper proposes a rationale and a plan for using 
on*llne data base retrieval services to provide bibliographies 
tailored to the information needs of college students enrolled in 
academic courses* It examines the possible applications of such a 
service, estimates costs per class and per user, ^nd outlines the 
objectives, evaluation procedures, and costs of a tvo*stage 
feasibility study of the programr Results of discussions with 
instructors and students concerning th3 program and examples of 
on--llne searches conducted for different courses are presented and 
discussed. (Author/CH) 
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ABSTRACT 



This paper proposes a rationale and a plan for 
using on line data base retrieval services to provide 
bibliographies tailored to the information needs of entire 
classes of students* It examines the possible applications 
of sush a service I estimates costs per class end per 
user; and outlines the objectives « evaluation procedures, 
and costs of a two stage feasibility study of the pro- 
gram. Results of discussions with several instructors 
and students concerning the program are reported,. 
On line searches conducted for three different courses 
as examples of applications of the service are also 
discussed. 
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EXPLANATORY NOTE ON ON-LINE BIBLIOGRAPHIC RETRIEVAL SYSTEBflS 



On-line computer-based retrieval of bibliographic in- 
formation hae been a major technological development of the 
1960*8 and '70*8. In recent yearSf academic libraries have 
begun to offer this service to their patrons by providing 
acess to the retrieval systems operated by the National 
Library of Medicine, the System Development Corporation 
of Santa Monicai Califomiaf and the Lockheed Information 
Retrieval Service of Palo Alto, California* This report 
assumes some familiarity on the part of the reader with the 
on-line retrieval process £ind with such terms as bibliographic' 
data bassf computer connect' time, etc* The following dia- 
grammatic representation developed by the Lockheed Company 
is offered as a basic overview of the system* Lockheed and 
SOC together provide access to over 60 data bases in the 
sciences, social sciences and the humanities* 
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WHAT GOES rNTO A DIALOG™ ONLINE BIBLIOGRAPHIC SEARCH?? 
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1 . WRITING: We ore being flooded wFth o 
torrent of reports, bodies, mogoztnei, joi,fmolf, 
ond newspopen, ond need some woy to find the 
tnformotion we wont, 

2. INDEXING AND ABSTRACTING; To help 
uf^. indexing service! o^ign terms to eoch docu* 
m^t to tell whot the crticle U obout, ond 
obttfocts of orticles ore also prepored. Vorious 
reference publishers provide this service, ond 
the Infbrmotion i> ovoiloble in both book form 
orut on compute r-reodoble mognetJc tope. 

3. LOADING AND ORGANIZING: Thew 

TM 

mognetic topes ore moiled to the DIALOG 
computer center ond ore looded into one of 30 
different reference dolo boses, tolollng more 
tKon 8 mllUon citotiOnS. (A cFlotion gives the 
tttle, outhor, publtcotion, key words, ond 
obstroct.) In the looding process the doto ore 
specjolly organized so that the Liformotion con 
loter be efficiently retrieved* 




(2) INDEXING ond 
AWTIUaiNG 



Computer 
reodoble 
mognetlc 
lopes 



Reference 
books 



J 



DIALOG 
Computer 



TM 



(a) LOADING 

ond ORGANIZING 
DATA 




Telephone 
line 




0 SEARCHING 



4. SEARCHING: The user occesses the 
TM 

DIALOG doto boses using o typewrHer*hke 
terminal connected toihe telephone lines. The 
termlnol ond the computer commumcote by meons 
of beeps thot ore tronsloted Into olphobetic ond 
numeric chorocters. The user chooses seorch 
ternns Ohot is, outhor nome, subject, rjtle words, 
etc.) thot ore opproprlote to the potror>*s 

question* The DIALOG^*^ computer then seorches the specmlly orronged ffles to ropidly locote 
citotloni thot contoin these seorch terms* The user eon osle the computer to inotch orwt combine 
these lets of citotlons to obtotn only those cifotlons thot sotjsfy certain combinations of seorch 
terms- (e*g* , Items on "solutions to the energy crisis involving solar power**)* The user con 
request that the citations ond obstracts be printed out at the termlnol or printed "off*IIne by the 
hlflhnpeed printer ot the computer center* The results ore then moiled to the user* 

The relewtice of the citotlons that you receive os a result of on online DIALOG^W depend 
00 the skills of the frwtexers who prepare the citotlons and the obillty of the librorlon searching 
the doto base* The Itbrorlon must understond both the noture of the vorlous doto bosesos vyell os 

mechonlcs of the DIALOG^W cortmwnds* The cost effectiveness of tt^ seorch olso depcrwts 
on the efftcleney of the DIALOG™ tyjtem, ond the computer etjulpment bvoiloble to do the job* 
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I. INTRODUCTION 

OBJECTIVES 

The purpose of thie report ie to explore the feasibility 
of ueing on-line data baee eervieee to prepare bibliographies 
tailored to the inetruetional neede of individual elassee* 
The baeie concept of operation ie that instructors and/or 
students would identify topics of Interest for a particular 
class and that the library would use its on-line data base 
service to provide multiple copies of bibliographies that 
identify references pertinent to those topics. The goal 
of this paper is to consider some of the problems and poten- 
tial uses of such an operationf to explore its probable costs 
per userf and to propose a two-stage pilot program designed 
to test its feasibility* 

BACKGROUND 

Within the past 2-3 years an increasing number of 
academic libraries have begun to offer on-line bibliogrsgphic 
data base services to their patrons* Because libraries are 
primarily oriented to serving the needs of their users on 
an individual basis (with the notable exception of the 
reserve book service ),'tiiere has been an implicit assumption 
in the literature that these services would be used pri- 
marily by individualSf each with his or her own information 
requirement * 

k major concern among librarians has been how the high 

cost of such services for individuals would be handled* 

Q Librarians have a strong tradition off and intellectual 
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eoouaitment to freedom of access to information* Freedom 
has implied "free" in the sense that no individual user is 
asked to pay for a specific library service* This tradition 
has been strongly buffetted in recent years, on the one 
hand by the growth of for-profit information service or- 
ganisations, and on the other hand by the development of 
highly sophisticated and very costly information retrieval 
systems* While the goals of these new systems are well 
within the scope of traditional library activities, their 
costs - which on a per user basis can be as high as $50- 
$100 - are not* With great reluctance and in the face of 
declining financial resources available to them, libraries 
have been forced to institute fees for this kind of service* 
It is an acknowledgement of the economic facts of life that 
the decision for many libraries now centers not on whether 
to charge, but rather which costs should be carried by the 
patron and which should be carried by the library* 

When the benefits and therefoi^the costs of on line 
searching can be distributed among several users, however, 
the per user cost can be reduced dramatically* An on-line 
search which has value for the members of an entire class 
has per user costs of an entirely different order of mag- 
nitude *. 

A review of the literature (1) has failed to identify 
any reports of on-line data base services being provided 
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for entire classes of students. A personal tour during 
the summer of 1975 (2) of colleges and universities offer- 
ing* or planning to offer on-line services also failed to 
locate any institution which vbs actively considering 
offering the service to classes. 

There are a few examples of programs that have 
sought to extend the benefits of a se^^h to more than one 
user. The National Library of Medicine* for instance* 
maintains a file of on<-line searches already conducted. If 
a potential user finds that a search on his or her topic 
has olready been performed* he or she can obtain a copy of 
the results without having to duplicate the e3qE>ensive search 
process. The Council on Library Resources has sponsored 
research that has experimented with group current awareness 
searches conducted for individuals who have exprenned an 
interest in the same general area of research* (3)* No one 
has experimented with such a program* however* for people 
whose interests are mutually focussed to the degree tv^at 
exists in a classroom. 

Ve may conclude that the concept of on-line bibliograph- 
ic services for closes of students has economic merit when 
considered on a cost per user basis. It also has potential merit 
a£'r>itn''innovative instituetional resource. The questions that 
remain are whether this kind of service would be useful and 
effective and how it could be most efficiently operated. 
We turn first to a consideration of the rationale for the 
program. 
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II. THE RATIONALE FOR OK LINE BIBLIOGRAPHIC SERVICES 

FOR CLASSES 

THE COMPLK yTTTES OF INFORMATION RETRIEVAL 

If 

The grovrth of the world*8 literature - the so called 
information explosion - has probably had more eerioue con*^ 
aequencee for the student etruggling to gain competence in 
a field than for the scholar worKing of the forefront of his 
or her discipline* The scholar can rely on the ixiformalt 
personal netwrok of colleagues and conferences that are a 
significant resource for stayiiig abreast of the newest devel*- 
opments in : ; a field. Thb student, on the other hand* must 
rely primarily on the traditional library toolsi the catalogs, 
HiB bibliographies, Hib indexir)g and abstracting publications* 
These secondary sources themselves have grown more numerous 
injrecent years, partly in response to the growth of lit- 
erature, partly in response to the increasing conqslexity of 
modem information needs. They have also become more 
sophisticated in terms of material and subjects covered and 
the types of access that they can provide. They have grdwn suf- 
ficiently complex that an increasing amount of time spent in 
the training and continuing education of librarians must 
be devoted to learning how to evaluate and use these new 
resources • 

Every secondary publication will have its own access 
vocabulary and system of name control, its own policies 
regarding material scanned, subjects included, number and 
type of index terms assigned per item, etc. Each of these 
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character is ties will have an influence on the value of that 
particular source for a particular question* We must then 
multiply that oouplexity by the ntmber of indexes and 
catalogs that nay be appropriate for that question* Regardless 
of whelher the information need ia intra- or interdisciplinaryt 
there can often be 5 10 bibliographic sources that coul4'' 
be profitably examined* A question related to federal policy 
on educational accountability t for example t could be usefully 
researched in PAIS»TH£ MONTHLY CATALOG, ERIC, CIS, SSCI, 

the NEtif YORK TIMES* A question involving drug therapy 
and schizophrenia could be researched in INDEX H^ICT^, 
EXCERPTA MEDICA, SCIENCE CITATION INDEX, BIOLOGICATj ABSTRACTS, 
CHEMICAL ABSTRACTS, PSYCHOLOGICAL ABSTRACTS, and PHARMOCOLOGY 
ABSTRACTS* 

Ironically, vrtiile the indexing tools have grown more 
sophisticated and reference librarians have improved their 
own Imowledge end competence in information search and re* 
-brieval techniques, the users, particularly students, have 
probably lapsed further behind in their understanding of 
how to conduct an effective search for Information, Rarely 
are undergraduates given any formal training in using 
library resourses* What training they do get comes from 
the reconaendationa of busy reference librarians irtio seldon 
have time to e:q)lore the full range of options and techniques 
available to a student* The rest is all too often self mis- 
education and the. complacency that comes with not knowing* 
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THE UN-GLORIES OF THE LITERATURE SEARCH 

Literature searching can be high adventure* Finding an 
article that supports on«fe own ideas - or contraditrts-fthsOj 
leamiJDg of a promising new technique, delving into the 
origins of a problem can all generate intellectual excitement 
that should be part of every student's e3qE>erience« Most 
of the time spent on literature searchingt howevert is 
anything but Intellectually challenging* Rather it is 
routine and mechanical t far removed from the ultimate goal 
of engagement with the material* The amount of time that must 
be spent simply identifying and locating material is often far 
out of proportion to the time that remadUfffl^ for actually 
readingt analysing, and evaluating it* Too frequently the 
result is that pe^pl«^»j^ e:t©prr-/: before the search strategy 
has exhausted its effectivenesst or they may turn to less 
comprehensive sources, or they may grow inconsistent in their 
searching* Tn shortt they do without information that could 
be very helpful to them* 

There aret howevert very importaixft intellectual tasks 
required in a literature searchtand it is these that should 
command the energy of the searchert the determination of the 
range of information needed to satisfy the questiont the 
formulation of the search strategyt the evaluation of initial 
resultSt the necessary revislonst etc* On-line computer 
condWflctetl retrieval offers the possibility of allowing us 
to focus our attention on precisely these tasks and to 
leave the mechanicalt time consuming tasks to the machine* 

14 
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EQUALIZING ACCESS t EJCPAHDING ACCESS 

Let US imagine the typical situation in which the in- 
structor aseii^e a paper topic that requires his or her 
students to locate pertinent references, analyse the infor- 
mation in these references in the context of ideas developed 
in the course* and surest some alternative approaches 
to the problem* There are actually two primary tasks 
involved in that assignmenti locating the infoxmation end 
then analysis and synthesis. The students begin with vary- 
ing library research skills* and depending upon their per- 
sistence* good fortune* and the number of others waiting at 
the reference desk for helpovill emerge with great variation 
in the amount and value of material each is able to identify 
and locate* The quality of final reports will depend to 
an important degree on their effectiveness in locating 
information. Yet as we noted earlier* effective literature 
search and retrieval now demand experience and skills that 
few students have an opportunity to acquire* 

The crucial point is that access to information In 

the learning environment of a university should not be a 

or 

competitive task*/allowed to be a hit or miss affair* 
subject to the widely varying experiences of users* Certain 
materials are placed on reserve for students so that all 
nay have equal access to the information they contain* 
Beyond that elementary procedure* however* no system is 
provided to insure students have equal opportunity to read 
and evaluate the items that may be most valuable or relevant 
for a particular assignment* 
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What is being proposed here is a procedure to help 
equalixe the opportunity for access to infonmatioawSolitiiat 
students nay get on with their primary learning tasks* On- 
line bibliographic services i&ay offer one means of insuring 
that all students in the class have the same benefit of the 
skills of an experienced reference librarian using one of 
the most sophisticated of modem retrieval tools* 

At the same timef though, such a program may allow an 
opportunity to expand access to information* As noted 
earlieri more than one bibliographic resource is usually 
pertinent to a given topic* If on-line services provide 
rapid access to the major files, students may have an 
opportunity to examine manually those sources they might not 
otherwise have reviewed* 
DEVELOPING LIBRARY RESEARCH SKILLS 

Providing bibliographic services to classes is not, however, 
a final solution to the more basic problem of helping students 
make more effective use of libraries* On-line services for 
classes have merit in their own right and ought to be com- 
plementascy to programs designed to help students improve 
their own information gathering skills* This complementary 
relatior^hip will be discussed in more detail in Section III* 
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III. POTENTIAL OSES AMD POTENTIAL USERS 

SOME POSSIBLE APPLICATIONS 

la preparing this report, the author spent some time 
discussing the possible uses of on-line services for classes 
with several instructors* Some sample machine'* generated 
bibliographies were also prepared for their evaluation* 
The results of these discussions and sample runs for three 
different classes are repopted in Appendix A* What follows 
here are some suggested uses of the program that emerged 
from those preliminary conversations and evlauations* More 
general consideration of uses and users will be takcui up 
at the end of Section III* 

EXAMPLE li BIBLIOGRAPHIES FOR PAPER TOPICS 

Let us imagine a small upper division undergraduate 
class of 20-30 students in which the instructor assigns 
a paper on some aspect of the course* Shortly before that 
assignment is made, the instructor re<luest8 that the library 
prepare a bibliography on the subject, based upon the 
information he or she has provided on the scope of the 
topic, the type of material and dates of primary interest, 
and some known relevant citatioi»* The library conducts 
a search of the 2 or 3 most perlts^t data bases and screens 
the ou'^ut for the obviously irrelevant jiaterial* The 
instructor then reviews the output, further eliminating 
items outside the scope of the topic and starring some of 
the more promising sources* The library adds locations 
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* 

and call ntmbers for those items it holds and produces the 
bibliography in multiple copies* The students use the abstracts, 
titles, and index terms to judge which references are of 
prima ry interest : to them* They also have time to explore 
some of the printed indexes not covered by the on-line search* 

If the search has identified a number of useful 
references, the search statements are stored in the conputer 
and rerun for the instructor the next time he or she assigns 
that topic* This followup run is mxoh cheaper than the 
original search, however, because the search strategy does 
not have to be re keyed and only material added since 
the last run needs to be screened* 

In addition, the instructor may wish to develop during 
the following year a bibliography for an alternative topic* 
Over 2-3 years several bibliographies can be produced 
for the course, and each can be very inexpensively updated 
for the current class* 

EXAMPLE 2 1 SUPPLEMENT TO THE READING LIST 

Consider a larger lower division course of 100 - I50 
students* Because of class size, the instructor does not 
usually assign a paper* Required and recommended reading 
lists are provided and students are eiqpected to integrate 
ledures and reading in answering examination questions* The 
course is in a rapidly evolving subject and is interdis- 
ciplinary in nature,! The instructor is interested in pro- 
viding students with a broader range, of recent journal articles 
to supplement the recommended lists in some of the course-^s 

* 
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key areas* Using the indicative words and phrases suggested 
by the instructor* the library searches abstracts* titles* 
and index terms in two on-line data bases* The results 
are screened by librarians and by the instructor and copies 
of the bibliography are provided for each student* Again* 
the search is saved and periodically updated* Over time* 
searches in several areas of interest are developed and 
are updated for each new class. 

EXAMPLE 3 1 ADVANCED SBMIMAR 

Consider now an advanced seminar of 5'-10 students* The 
students are e3q;)ected to prepare and present a paper on 
some aspect of the topic being considered in the course* 
Even though they may each focus on different dimensions of 
the subject* these individual efforts will be related 
because they will all focus on one general topic* At some 
point in their research* usually after they have had an 
opportunity to examine some of the available material* 
the students would prepare a statement of their research 
interests* After meeting with the students as a group to 
discuss possible search stategies* the librarian would 
develop these statements into a combined search request and 
organise a print out that identified articles of general 
interest to the whole class* as well as articles that were 
of interest to each individual* The search would be run 
against 2-3 data bases judged likely to be most productive* 
Using this bibliography to identfy a major portion of the 
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of the relevant literature i students could then pursue 
their topics in other secondesc^ resources and also in 
references cited by the authors listed in the on-line 
produced bibliography. 

THE IMTERACTIVE_J:FFECT 

The examples cited above are based upon comments by 
instructors and students about ways they now see to use 
on-line retrieval. There are potentially many other ways 
that on~line service . could be employed for classes t once 
instructors and students become more familiar with its 
capabilities. For some classes f it might provide access 
to references and information on topics not previously 
included in the course because of the difficulty of obtaining 
worthwhile material i for other classes it might be a resource 
instructors could use to develop alternative teaching 
strategies. One of the objectives of the feasibility studies 
discussed later in this report is to establish some of the 
ways on-line retrieval could be employed as an instructional 
resource, 

DATA BASE CONTENT AND COURSE CONTENT 

One of the key issues that will have a strong effect on 
the usefulness of this service is the match between the 
subject matter covered by available data bases and the subject 
matter covered in courses* Criven the range of courses avail- 
able in a university end the range of data bases access*" 
ible on-line, it is impossible to predict that match* It 
can only be studied' by an actual test of the program, 
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* 

la -Uiis context* a key task of librarians ia to under- 
stand th« infoxmation needs of instructors and students 
and to be prepax^d to suggest the sources that might meet 
those needs* This is the traditional job of the reference 
librarian* and it can readily be extended to -Uie teaching/ 
learning environment of the classroom* 

EFFECT OH THE IHFQRMATIQH GATHERIHG ABILITIES OF STUBENTS 

As noted earlier* on-line services for classes should 
ideally be integrated with a general program whose goal is 
to help students improve their information gathering 
abilities* IThere are several ways in vftiich the iiroposed 
on line service could assist in attaining such a goal* 

For a bibliography prepared for a large class* for 
instance* a librarian could discuss with the class -Uie way 
in which ate search was prepared* how to interpret and use 
the results* the limitations of the search strategy and 
'Uie data bases* ways to compensate for these limitations* 
other resources to examine, etc* IThis approach could pro- 
vide some foxmal and very useful instruction v in literature 
search techniques in^ much more systematic way to a larger 
group of students than can be accommodated at one time at 
the re£tsnoe dask* ftlso* It is extremely important for 
users to understand what an on-line search can and cannot 
do* and some type of explanation of these limits ought to 
be an integral part of the program* 

For smaller* advanced seminar groups* the benefits can 
be even greater as students irrestle with the tasks of stating 
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their information need* formulating a search strategy* naking 
an initial surrey of the printed Indexes* etc. The librarian 
could tteet profitably with this group at least twice* 
once to discuss the development of a search request* and 
once to discws the results of that search. The instruction 
in information collection co^'ld be at a more detailed and 
advanced level for this kind of student group. 

GEHERAL COKSrOERATIOHS CONCERNING POTENTIAL USERS 

It is useful at this point to recast the ideas of the 
preceding discussions into a more general mold. Figure 1 
represents such an attempt by identifying some of the key 
factors that could influence the use of on-line services 
for classes. Whether an on-line data base search can be 
effectively utilized will depend on such factors as the 
style of the instructor for that particular course* the 
abilities of the students* the nature of the subject matter* 
and the course requirements. For each of these facdts* there 
will be a^set of alternatives* some of which will be far 
more conducive to the use of the sei^;v}5e than others. In 
FIGURE 1* some of the more important of these alternatives 
are suggested and their influence Is postulated. In 
effect* it is hypothesized that as one moves to either of the 
extremes for a given factor* the less useful on line services 
would be. For example* for the dimension NATURE OF COURSE 
SUSJECT MATTER* we can see that an introductory course in the 
calculus would fit the definition on the far left of that 
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FIGURC 1 

MAJOR FACTORS LIHELV TO IMFLUENCE USE OF ON-LINE SERVICES 
(lines running thru an alternative suggest on-line retrieval may be appropriate for some 
courses meeting that description) 



POTENTIAL FOR EFFECTH/E USE^ ON-LINC RETRIEt/A L 



FACTORS : 



INSTRUCTOR* 3 
STVLE FOR 
THAT CSE. 



provides etrudtured, 
directed approach to 
subject & material 



COURSE'- 
RFpUlREMENTS 



/ 



/ diversified approach^ open 
to use of any pertinent 
lit. 



open approach but 
strong emphasis on 
student learning to 
locate a feu primary 
documents 



multiple choice 
questions fr. 
lectures & 
assigned rdg. 



essay exams 
fr lectures 
\ & optional 
>rdg 



short written 
assignments 
fr recommended 
rdg. 



individual 
research on 
assigned 
topic 



individual 
rese^ch on 
topici of own 
choice 



a^v. cee . with 
piJ.me emph . on 
ar^l. of limited 
bopy of estab. 
terial 




CO 
GO 



N^^TURE OF 
COURSE 

SUBJECT MATTER 



basic course 
with eell 
estab. content 
in 1-2 tests 



STUDEWTS' 
ABILITIES 



ngeO to dev^op 
basic aca^mlc 
skills infrdg^ 
anal, t wr|.ting 



netj approaches^ theories 
exp. resu}.ts continually 
evolving and reported 
in lit. cse is in 
traditional discipline 



isciplinei 
on ijork 
areas 



il. t t^T^t 



have sat. competence 

in basic acad. skills, 
need experience with 
diversity of info 
resources 



.dJell developed acad* 
.nterests 
ilds not well 
by data bases. 



^iQeii oeveic 

/skills, ir 
lie in fie: 
covered by 
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dinension - "basic souree with well established content 
represented in 1-2 texts'* - and would likely fall outside the 
range of courses|that could »ake effective use of on^'line 
retrieval* Slailarly, a course at the other end of the 
dimensioni such as an "advanced topics in energy seminar** 
sight be BO dlfft^e and individualized -Uiat a common search 
strategy would have little value for all the ol^s participants* 

The purpose of FIGUBB 1 is to suggest some of the most 
critical factors and hypothesize their effects* The position- 
ing of the **effective use** bot/dary lines would have to be 
adjusted as a result of the initial feasibility studies* 
Even then* however, they would be nothing more 'Uian guide- 
linesV The match between the bibliographic needs of any 
course and the available on line resources will always have to 
be assessed individually* The most that FIGURE 1 can do is 
suggest -Uie most likely candidate courses* 
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IV, COST ESTIMATES 



ESTABLISHING. THE RANGES 

The objective of this portion of the report is to identify 
the major cost elements in the service being proposed* Be- 
cause there are so mai^ variables and unicnowns involved, the 
potential costs can only be estimated in terms of the likely 
ranges* 

There are three major categories of costs: the charges 
of the commercial providers of on-line access (e*g* sOC and 
Lockheed, and the telecommimicatioiss companies )i thecosts 
to the library for professional librarians* time, and for 
equipment such as terminals} and the production costs for 
providing multiple copies of the bibliography* Each of these 
will be discussed in turn below* TABLE 1 summarises -Uiese 
discussions by listing the range of cost estimates for each 
element in each category* Following the diecussion of 
categories, we will consider two hypothetical examples 
of cost ^imates for two different classes* 

CHARGES BY COMMERCIAL PROYIEgtS 
1* Computer connect tine* 

Charges range from $25/hr for some data bases to 
$120/W for others* On a per minute basis -Uie range is 
*40 to $2*00* 

2* Telecommunications 

The charge for phone connect time is $8-10/1u', assuming 
one has access to a commercial low cost long distance 

* 

phone service* 
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TABLE 1 

ESTXH&TB OF RANGE OF COSTS FOR ON LINE SERVICES FOR CLASSES* 

RANGE 

In dollars In hours 



!• Charges by eonmereial 
providers 

a* computer connect 
time 

y>t tele coiamunicat ions 
c* citations printed 
offline 



•4^0-2.00/min. 

.13-.17/ifflin 

.05-.50/cite 



2. Costs of the library 

a* Professional Pers* 
1* presearch Interview 
2« search strategy 

development 
3* search time on 

line 
post search 

screening 
5* post search 

explanation 



b* equipment & 
si^plles 



3* Production costs 

a* location & 

call numbers 
b* prep masters 
c* produce copies 



2,000 - 3,000# 
per year 



5-10/8earch 
4-18/search 
1 • 2 5-2 • So/ee arch 



• 2 5-2 • Oahr/B ear bh 
•S-ltO hr/search 
•l6-*67 hr/search 
•5-1*0 hr/searoh 
•5-1*0 hr/searoh 



* See section IV of this report for discussion of assumptiona 
used in calculation of these estimates • 

# This cost would be shared among all users or absorbed 
by the library - or some combination thereof • 
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3. Citatione printed off line 

The range is 5^ 'to SOi per elation* again depending 
upon the data base searched* 

COSTS TO THE LIBRARY 

1* Professional personnel* 

Because these costs and their manner of computation 
will vary from institution to institution* these estimates 
are computed in terms of time rather than money* 
A* Pre-search interview* 

Very little data based on long term operatior^ is 
avallble yet for making this estimate* A recent study ax 
Georgia Tech and UCLA (4) found that most times ranged 
between 15 and ^5 minutes* For a program involving on 
line services for classes* It would be necessary to add to 
this figure t 

1) Time spent to promote and explain -Uie service 
to instructors during the first 1-2 years of Its existence* 
Estimated at an additional *5 hours per class* 

2) Time spent with advanced classes explaining 
the nature of literature searching* search formulation* etc* 
Estimated at *5-*75 hr/class* 

The range of pre-search interview activities Is 
therefore estimated at *25-2*0 hr/class* 

B* Search strategy development 

Again, very little long range operational experiace 
1b available* Estimajbes have ranged from 15-^5 minutes* (5) 
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ThiB is a cost that should decrease over timet as the 
searcher becomes more experienced* (6)« Tor an instructor 
raquiring a bibliography on a fairly clear cut topic, the 
search strategy phase should run 10*20 minutes* For advanced 
classes, however, in which each student has a different 
aspect of a general subject, the search strategy foxmu^H^icn 
could become complex and time consuming* factors should 

help eliminate some of the problems at this end of the 
scale* First, some advanced classes will play an active role 
in developing their own strategies* second, if the inf er- 
uption requests become too diffuse, a combined search could 
probably not be conducted anyway* 

The most lively range for this category Is estimated at 
30-60 minutes* 

C* On-line search time* 

The average time required for on-line searching 
can vary greatly (5*20 minutes) (6) and at $2*00/min this 
factor can greatly influence final costs* There are indications 
that time per search does decline as the searchers become 
more proficient* (6)* 

The estimated rar^e used here will be 10 -^0 minutes* 



D* Post-search screening 

One of the ways to reduce on-line costs is to 
screen 'Uie results of a search strategy off-line * It may be 
cheaper to -Uiink at lO^/cltatlon than at $2*00/minute* In 
addition, the search analyst may wish to screen out citatioi» 
'Uiat are obviously Irrelevant in order to facilitate screening 
ERXC ^ ^® instructor. 2g 
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This type of screening based upon the citation 
alone would probably require 3O-6O minutes of a librarian's 
time* and 1-2 hours of the instructor's time* 

£* Bost^- search explanation* 

Finally* the librariar. would want to spend somo 
tine with each class explaining the streng^s and limits 
of the bibliography* other sources to examine* etc. 
This time is estlEoated at *5-l*0hr/class. 



2. Equipment and supplies 

Texvinal rental and supporting documents such bs 
thesauri and updated postings lists are additional costs 
'Uiat have to be borne in providing on-line service. %ese 
costs will vary and are not directly attributable on an 
individual search basis. The amnunt that each user would 
have to be charged to recover these costs would depend 
on the number of annual users. One alternative would be 
for the library to absorb these costs as part of its equip- 
ment and supplies overhead. Or users could be oliarged 
on the basis of the on-line time required to conduct their 
search. The issue involves a policy decision as well as 
a cost estimate. The range would be in the vicinity of 
of $2000-3000/year for rental of terminal* ps^er supplies* 
phone installations* ajid supporting documents. 
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PRODUCTION COSTS 

1. Adding locations and call numbers. 

To increase the time and efficiency/ value of the 
of the bibliography for its users, the library could assign 
call numbers and locations to the Items it holds* This oper- 
ation could be performed fairly i::iexpensively relative to 
the total cost of a search and would assist all users as 
wejQ. as reduce the frustration of searching for a relevant 
document the library does not hold. 

Using a consolidated listing of periodicals, journal 
titles could be locatr4 at the rate of at least one per 
minute. For bibliographies with books, an additional 5 minutes 
per title would be added in order to search the card catalog. 
The library could also append a list of reports (e.g. ERIC 
documents or NT3S documents) it regularly receives. 

If we assume an average of75-100 periodical titles 
and 3-5 books per off line print out, the look rates 
suggested above would add 2-3 hours of clerical time per 
search. Assuming a rate of $3-V^r (direct labor and 
labor related benefits only) this would add $5*10 to the 
cost of a search. 

2. Preparation of the master 

Once the relevant citations are selected and call 
numbers assigned, a page master can be arranged simply by cut- 
ting and pasting. If we assume 100 - 200 citations retrieved 
per search, 4 citations to a page, the resulting 25 - 50 
pages would require (at 3 minutes per page) 1.25 - 3*5 hours 
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to prepare. Assuming a clerical rate of $3-5Aour« we would 
add $4-18 per search. 

3. Production of multiple copies 

Commercial rateB can range from S^/page down to 2-3 0 
depending upon volume. For 25 - 100 pages per search the 
cost per student copy would be $1.25 - $2.50. 

CHARGES PER CLASS 

The costs listed above for commercial charges* production 
costs* and time for the search strategy development* on line 
time and post search screening would all have to be multiplied 
by the number of data bases searched per class. It is 
assumed that the professional librarian's time for the pre> 
search interview and the post-search explanation would be 
within the ranges su^ested regardless of the number of 
data bases searched. The average number of data bases 
appropriate for a given course topic can only be determined 
by a test run of the program. For some* one will be completely 
adequate ( lor others ^5 might have to be considered. 

COST ESTIMATIMQ.- FORMULA 

A. formula for estimating costs per class is proposed 
in FIGURE 2. This formula is used for . computing the sample 
class costs illustrated in TABLES 2 & 3* To provide some 
concrete examples for discussion* we shall now coimider 
those two hypothetical canee. 
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FIGURE 1 



FORMULA FOR ESTIMATING COSTS 
PER CLASS 



Coflt per class* 



/♦Commercial 
Charge.?*/ 




i ST^CCCTj^ + TCj^) + KCRj^(CPCi) 



/♦Production 
Costs*/ + 



LCK^ + PM, + CC^ 



/♦Professional 
Librarians 



Tine*/ 



SSDj^ + STih + PSSi 



+ PSI + PSE 



/♦Equipment & 

Si^ipliesV •¥ Per user share of E&S 

Where 

n » number of data bases searched 

DBS » data base searched 

ST » search time on-line in minutes 

CCT » ooiq>uter connect t^e costs per data base per minute 
TC » telecommunications costs per minute 
NCR » number of citations retrieved 
CPC « float per citation printed 






Where 



KJC » number of journals cited 



NBC e number of books cited 



CWC » clerical wage cost (direct labor 
and labor related benefits) 
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FIGURE X (cont'd) 

P« «(NCPjl/CPPjl) X TPM X WC 
Where 

NOP " num1>er of citations printed in 
bibliography 

CPP " citations per page 

TFH ■ time to cut and past&page master 
per hour 

CC « NC X (NCPjl/CPPjl) x CPCO 
Where 

NC " nitsber of copies required 

-.''■J • • 

CPCO" cost per copy 

1^0 ■ search strategy development in hours 
STh " search time on line in hours 
PSS " post-search screening in hours 
PSI ■ pre^search interview in hours 
PSE a post-search explanation in hours 
E&S ■ equipment and supplies 
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COST ESTIMATE PER CLASS i EXAMPLE 1 

The program has been in operation for several years 
and promotional activity is no longer required* The search 
librarians have become very proficient in using the on-line 
systems • 

An instructor .requests a bibliography of recent (p^t 
2 years) material dealing with the psychological effects 
of sensory deprivation with its possible effects on early 
childhood learning* The librarian conducts a 20 minute 
search on PSTCH ABSTRACTS and a 20 minute search on ERIC* 
150 citations are printed off-line from each data base* 
To reduce costs* the ERIC citations are printed without 
abatractst the largn, number of descriptors assigned in the 
ERIC . data base to each document are judged sufficient for esti- 
liia't;:in& the value of the article* A total of 200 are : 
included in the final list for the bibliography and 100 
copies are prepared for the students* 

Using the assumptions listed in TABLE 2A» we can 
compute the estimated costs of the bibliography to be 
approximately $330« plud 3*85 hours of professional 
librarian's time* The cost per student for the 100 members 
of the class can be estimated at between $3-and $3*50* 

From the computations in TABLE 2B we can see that the 
major cost for this class is the duplication^ costs for 
100 copies* Of the $3 '^o $3*50 per student, $2*50 is re- 
quired for producing each individual's copy* Doubling the 
on-line search time for both searches would add only 30^ 
more per student to the overall costs* Ve have wsed a 
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TABLE 2A 

VALUES ASSUHED FOR COMPUTING COSTS FOR EXAMPLE 1 

DATA BASE 

COST ELEMENT PSYCH ABS, ERIC 
(SEE FIGURE ' 









OCT 






X w 




•17 


NCR 






CPC 


.10 


.OS 


NJC 


^0 




KBC 




A 

V 


CWC 


^*00 


K AA 


NOP 


100 


1 AO 


CPP 


f 






JJ/OO 


3/00 


KC 


100 


100 


CPCO 


.05 


•05 


SSD 


.5 


•5 


STh 


.3 




FSS 


.5 


•5 


PSI 


.5* 




FSS 


.75* 





*Qn« time cost assigned to first data base searched 
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TABLE 2B 

COST ESTIMATE FOR A CLASS t EXAKPLE 1 

(Gstijnate based on cost formulat FIGURE 2» and 
asaumptione listed in TABLE 2A) 

DATA BASH SEARCHED 

PSYCH. ABSTRACTS gRIC 

dollars hro* dollars hrs. 

Commercial 
charges 

a* computer connect 20*00 11*40 
& cotnmun* 

t] off line print 15.00 7*50 

Production 

a* location & 

call no* 6*25 4^*20 

prep master 6*25 6*25 

c* copies 125*00 125*00 

Library coats 

ft* pr«-search interv* *5* • 

b* search strat dev* «3 *5 

c* on-line tljne «3 *3 

d« screening *5 • *5 

•* post* search explan* «75* * 



172.50 2»55 15*»35 1*3 

Total commercial charges and producticm costs m 3Z6*B5 
Total professional librarian time m 3*85 hr 

*One time cost assigned to fi:rst data base searched 
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very high cost for copying » however » and If special handling 
requirements can be minimised, it may be possible to reduce 
these costs to 2-3^ per page for large classes* At that rate 
t^e per student cost would drop to $1*00 - $1*50* The 
feasibility study can shed some important light here* 



COST ESTIMATE PER CLASS i EXAMPLE 2 

A blbliogri^hy on communication among bees is prepared 
for en upper division class studying animal communication 
in general. The librarian conducts a search on BI0S3S, CAIN, 
and SCIENCE CITATION INDEX* The search time for the first 
two data bases is 30 minutes each because the librarian is 
relatively new to on-line searching and because the un- 
controlled vocabulary of BI(^IS and CAIN make searching more 
difficult. The CITATION INDEX search takes 15 minutes* 100 
ciatations from each data base are printed off line* 50 
from each are then selected for inclusion in the bibliogri^hy. 
20 copies are provided and the librarian spends 20 minutes 
with the class on the post search explanation* Estimated 
costs for the bibliogri^hy asicomputed in TABIoEs 5A-3B 
total approximately $150 or $7*50 per studentc plus ^*5 
hours of professional librarian's time* 

In this instance the cost of copyiiig the bibliography 
for each student is only $1*50 per student* if the on-line 
search time could be cut in half by a more experienced searcher 
the costs per student would drop to $5*50* Alternatively, if 
only BI0S3S were searched, the cost per student would drop 
to liess than $3*50 plus 2 liours of professional librarian's 
>9r> time* 
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TABLE 3A 

VALUES ASSUMED FOR COMPUTING COSTS FOR EXAMPLE 2 



RATA BASE 

COST ELEMENT 

(SEE FIGURE SCIENCE CITATION 

2) BIOS IS CAIK INDEX 



ST 


30 


30 


15 


OCT 


1.10 




1.17 


TC 


.17 


.17 


.17 


NCR 


100 


iOO 


100 


CPC 


• 10 


.05 


.10 


NJC 


50 


50 


50 


NBC 


0 


0 


0 


CVC 


5.00 


5.00 


5.00 


NCP 


50 


50 


50 


CP? 






10 




3/O0 


3/00 


3/60 


NC 


20 


20 


20 


CPCO 


.05 


.05 


.05 


SSD 


.3 


.3 


.3 


STh 


.5 


. .5 


.25 


FSS 


.5 


.5 


.5 


PSI 


.5* 






PSS 


.3* 







*One time cost applied to flret data base searched 
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TABLE 3B 

COST £STIWIT£ FOR A CLASS t EXAMPLE 2 

(EBtimatee based on cost fornula* FICURE Z, and 
aseunptions listed in TABLE 3A} 



Conmercial 

chatges 

a* eosiputer 
connect it 
co»nun« 

b. off line 
print 



B^OSIS 
dollars hrs. 
38.10 



10.00 



DATA BASE SEARCHED 



SCIENCE 
CITA, INDEX 



dollars hrs. dollars hrs 
17.70 20.10 



5.00 



10.00 



Production 

a. location 

ft call no. 4.20 

b. prep na&ter 3*25 
Q. copies 13*00 



^^.20 
3.25 
13*00 



4^.20 

1.25 
5.00 



Library costs 

a. pre search 

interview 

b. search strat 

devel . 

e. en line time 

d. screening 

e. post search 
ex^lan. 



.3 
.5 



.3* 



68.55 2.1hr 



W.15 



.3 
.5 



.3 
.25 



1.3hr ifO.55 1.05h 



Total commercial charges and production costsn $ 152.25 
Total professional librarian time « k»k^xr 
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OPyiOKS IN THE SERVICE 

The two examples above si^est some of the procedural and 
cost options in conducting the service* There can be im- 
portant variations in on*line search time* number of data 
b^es scanned* number of citations printed out, number of 
copies produced* etc* If a primary goal is lower costs 
but broad coverage foija large clafcis* for example, fewer 
copies fo^ the bibliography might be produced and placed on 
reserve* Alternatively* during the post search explanation 
the librarian might suggest a detailed search strategy for 
a relevant data base that could not be scanned on line 
because of the costs involved* Once the service in in 
operation, there are many program options that could 
develop to meet the bibliographic needs of a specific group 
of students* 

PAYING FOR THE PRDSHAM 

Even though the per user costs for this service are much 
a search 

lower than when/conducted for a single individual* the total 
costs are still relatively high* There are four basic 
sources for funding such a service on an on going basis i 

1* The University 

2* The Library 

3* The Academic Z^epartment 

4* The Student Users 
It is arguable that the iiniversity or the Academic 
department should fund the service in the same way that 
classroom science laboratories or computer time for 
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inBtructional purposes are provided* The Library is a 
less likely source because the costs of the service on a 
university wide basis are far too high* 

Xhe student user could be asked to fund the service 
as the ultiniate beneficiary , although the per user costs 
would undoubtedly have to be quite low before that option 
oould be realistically considered* Whether it would be 
philosophically acceptable would depend upon the university's 
view of the student's obligation for the financial support 
of his own education* There are mixed precedents in this 
area* including the free-to-all reserve book service* the 
book store which stocks $10*$30 required texts* the lecture 
notes service m^ich operates on a voluntary subscription 
basis' at $4-$8 per user* 

It is not the intent of this report to eicplore these options 
in greater detail ■ other than to surest that the final 
solution could well be a combination of these sources based 
upon some rationale for identifying the obligation of each* 
Students ■ for example ■ might be asked to pay the cost of 
producin,g their own copiest the university and the depart- 
ment might carry the charges for computer connect timei 
off-line printing, and the librarian's instructional time 
spent with each class} the library might carry the remaining 
costs of the professional librarian's time* Whatever 
formula mi^ht evclve, it should be based upon an assess- 
ment of the iistructional value of the service and its 
relationship to the educational goals of the university* 
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Obviously« it must aleo be based upon the potential 
fmders* capacity to support it. The philosophical 
and pedagodgical discussion must come firsts however^ 
because it mwst be established in advance whether the 
program should be regarded as a h^Bic instructional resource 
of the university for equalizing and expanding access to 
information or as a convenient aid students which should 
be . ^ed solely by its ultimate users* 
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V. A PROPOSED FEASIBILITY STUDY 
CONSIDERATIOMS 

Before the proposed service can ^ offered on a full 
Bcale basis to the university, it Meds to be tested in a 
controlled pilot program. It was evident from discussions 
wiht a dozen faculty members at UCLA that the development 
of the s^trvice would require active promotion by the librery. 
Because on-line services themselves are new to the librarian 
and ufiers alike, the ways in vrtiich they can be used as 
an instructional resource for entire classes are not always 
evident. For many classes, of course, they will sijnply not 
be appropriate at all (see FIGURE 1). In addition, some 
faculty will not wi€h to use the service because they have 
found their current teaching me)t3aods and course organisation 
satisfactory. 

Faculty members who were mozre receptive to the service 
also had many questions, however. It is clear that librarian's 
will have to spend tine in the initial stages of the program 
understanding the bibliographic needs of instructors and 
carefully explaining the strengths and limits of the service. 

the major objective of Stage 1 of the pilot program* 
therefore, is to begin explain^ig and discussing the service 
with members of ttiB faculty and developing some sample cases 
in which on line retrieval is successfully utilised. An 
additional objective is to carry out the entire seryice 
from pre-search interview to student evaluation of the 
product, in order to detexmine Hie most effective operating 
procedures . 
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Stage 2 of the pUot program should be designed to examine on 
broader basis the potjential usefulness of the service 
and its capacity to support a wide range of curriculum 
objectives* 

ADMINISTRATION AHD COWTROL 

Although the program should initially be coordinated 
from a central post, especially to insure equity in resource 
allocation and systematic evaluation* the primary locus of 
control and energy should shift as rapidly as possible to the 
local units* The strength of a decentralized library lies 
in the capacity of the individual units to listen-tOi under- 
standi and serve more effectively the needs of their par- 
ticular patrons I It is at this operational level that 
the professional staff h^ the most opportunity to be 
aware of the interests of their users and tailor the services 
of the library to best serve those interests* This program 
will require a high energy commitment) respecially at the 
beginnlngi becaS^ it requires active reaching out to 
potential users of the service* 1^ keeping the number of 
classes small at the beginning and placing as much control 
as possible in the local xinits* however« there should be 
enoi^ coHective energy and sharing of ideas to develop a 
good service* 

Because this will be the first contact for many users 
with on-line retrieval, it will be very important to take 
special care in producing the best possible bibliography and 
advising the users on what to expect and not expect* 
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PILOT PROJECT I STAGE 1 
1* Objectives 

A* identify and seek remedies for problems encountered 
in providing the complete service to a class 

B* Explain and demonstrate the service and obtain 
feedback on its potential usefulness i.to an 
Instructor and to a class 

C* develop procedures and cost estimates for a program 
offered on a wider basis* 

D* obtain samples of good bibliographies for use in 
further demoi»tratioi:^» 

2* Sample classes and applications 

Because a primary goal of stage 1 Is to test the full 
service in operation* the range of disciplines served is 
somewhat less Important than during stage 2* Any application 
for vftiich on-line retrieval would be appropriate could be 
usefully tested* even If It involved only a small portion 
of the course content* If the application has potential 
as an example or a test caee* It would be worth including In 
stage 1* In fact* instructors would probably be more likely 
to try the service for a small portion of the course rather 
than place major emphasis on an experimental program* 

Demonstrations for the faculty would also be a 
valuable part of this stage if such sessions could generate 
feedback from the Instructors on how the service oould be 
employed in their classes* 

3* Evaluation 

At each stage of the process* data should be collected 
on the time spent* actual costs incurred* etc* This information 
could be conveniently collected by the use of a standard 
recording form prepared for each class* See suggested form* 
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APPENDIX B. 

The evaluation of the usefttlness of the bibliography 
would require comment from the instructor and the students* 
It would be important to have feedback from the students 
on how they used the bibliography* Inqprovements they would 
suggest t and the amount they would considerable reasonable 
if they were asked to share the cost* See the suggested 
questionnaire in APPENDIX C* 

Feedback from the intstructor should focus on his or her 
expectations of the service t whether these expectations were 
fulfilledt suggestions for Inqprovements t other ways he or 
she might em|)loy on line retrieval for the class t and 
whether the service were useful enough to seek ways to fund 
it on a regular basis* See the suggested questions, APPQfDIX 
D. 

It is recommended that feedback from students be collected 
by a questionnaire completed during class time* Feedback 
from instructors should be collected in interviews that 
focus on the questions in APPENDIX D* This will allow open 
ended discussions and follow up questions when appropriate. 

In addition, the adequacy of the on-line bibliography 
should be evaluated in a general way from the point of view 
of the information specialist* The purpose of this 
evaluation would be to detexmine whether the most effective 
sear^ strategy had been employedt whether the appropriate 
data bases had been scanned t whether a manual sear^ would 
have been more effectivet etc* This will require a general 
qualitative assessment by a senior reference librarian* 
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Set APPENDIX £. While a complete so-oalled "failure analysis" 
is beyond the scope of this pilot projecti it is important 
to have some evaluation of the product of on-line retrieval 
fron an information specialists perspective* 

Time schedule 

It is important to have axmost all participating 
faculty identified by the end of week two of a given 
quarter (at the latest) in order to allow time to integrate 
the bibliography in the curriculum. 

Ihe goal of a 1 week turnaround time from pre- search 
interview to delivery of bibliography should also be an 
objective so that the program can maintO^ flexibility 
and . resS^siveness* It would be self-defeating to have 
the speed of on-line retrieval lost in a two month turnaround. 

Given the development and explanation goal of these 
atagSi however* it would also be valuable to use some portion 
«f the pilot project resources for demonstrations throughout 
the quarter* If turnaround can meet the standard outlined 
balow, it would be pessible to serve other faculty who learn 
of tha program late in the quarter but vAio still wish to 
obtain a bibliography for their course. 

yumaround Goal 

Day It Instructor conipletes information request formt 
Pre^seareh interview! Search strategy developed) 
Searc^ conducted. ^ 

Day kt PrintjDut arrivesi Librarian screens print out 

Day 5( Instructor screens printj^ut 

Day ot Add locations & call numbers t prepare masters 

Bay 7t Produce copies and deliver 
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5* C08t8 

In computing the cost per class during stage 1| the 
following assumptions were madet 

A. Oti'line search time would be high (average « 40 min*) 
because of the newness of on'line systems to the library* 

6, An average of 2 data bases would be searched per 

class* 

C* Searching would occur primarily in 12 data basest 



minute is equal to the average connect time charges per 
minute for these 12 data bases* 

0* 200 citations per data base searched would be 

printed * 

B* The final bibliography would contain 300 
citations or 75 pages* 

F* An average of 20 copies of the bibliography 
per cl^s would be required* 

G* A professional librarian would be involved in 
the following tasks per classt (assumes 2 searches per cl^s) 



ASI 
BIOS IS 
CAIN 
OHEiaAB 



INSFEC 

mis 

PSYCH A6S 
SSCI 
MEDLINE 
NYTDB 



CIS 
ERIC 



The estimated cost of computer connect time per 



-Contacting prospective users 

-Pre search interview 

Search strategy development 

-Online search time 

-Post search screen 

-Post search eicplan* to class 

-Evaluation 



l*Cf hr/class 
,5 hr/class 
1*5 hr/class 
1*3 hr/class 
1*0 hr/class 
*5 hr/class 
2.5 hr/class 
6*3 hr/class 
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From these smsunrptions, the followijig values were 
derived for insertion, in the cost estimating formula 
(FIGURE 2) I 

m m 2 NBC « 10 

ST « ifrO min ClfC « $5.00 

OCT » .95 NOP » 150 

TC « .17 CPP » ^ 

NCR » 200 TPK » 3/60 

CPC a 10^ NC «= 20 

NJC » 75 CPCO» 50 

(Againi it must be emphasized that these figures are used 

solely for the purpose of arriving at some estimate of the 

cost of 'tile service. Only the pilot programs will be able 

to determine what these numbers should actually be) 

-The cost per cl^s is therefore estimated att 

$ 250 per class 

Plus 8.3 hours of professional librarian's time 
-For a projected stage 1 of 10 classesi the estimated 
cost of ttie project ist 

$ 2500 

Plus 83 hours of professional librarian's time 

PILOT PROJECT I STAGE 2 
1. Objectives! 

A. conduct a more broadly based study of the value 
and application of the service 

B. test, evaluate procedures designed for a fully 
operational program 

C. develop final cost estimates 

D. identify sources for funding 
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2. Sasrple elassea and applieatione* 

Courses in the humanitieSf seieneeSf and social 
sciences should te involved, and classes of various sizes 
and orientation (introductory, advanced, etc,) should be 
represented. An estimate of the number of closes 
involved must await results from stage 1 lohich should provide 
some indication of the potential demand. 

3* Evaluation. 

While the evaluation forms from stage 1 can serve 
as a guide, new issues will undoubtedly emerge from that 
test, and will require other feedback questions and procedures. 

^. Costs. 

Costs for stage 2 should be projected from the results 
of stage 1. 
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VI. LIBRARIANS! 'BE UNTAPPED INSTRUCTIONAL RESOURCE 

Regardless of the technology being employed t one of the 
most intriguing aspects of this proposal is its implication 
for the role of librarians in the educational process. 
Sy tailoring the resources of the library to the needs and 
goals of entire classes of student^i-Uie librarian can make 
a unique contribution to the learning process and the 
educational growth of many individuals. Librarians have the 
tools and Icnowledge to help make their vast storehouses 
more responsive and accessible to instructors and students. 
It is appropriate that these skills should become a more 
integral part of the classroom environment. 
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A-1 

REPORT ON SAMPLE SEARCHES RUN FOR 3 INSTRUCTORS 



As part of the Daekground for this report fBanple eearehes 
wer« conducted for three instructors irtio expressed an in- 
terest in the program. The goal of these searches was ' to 
demonstrate the process and the product of on'^line retrieval 
and to use the saaqple runs and printouts as a basis for 
discussing possible appjtications of the service in these 
instiructors^ classes* Several search strategies and data 
bases were tested for each question and several sample print- 
outs were produced off line for evaluation. Jtar these 
sample runs there was no in'tention to produce an exhaustive 
search and there will not be a detailed report on the 
effectiveness of the particular search strategies or the 
data bases employed* 

SAMPLE CLASS BIBLIOGRAPHY 1 

Two instructors irtio teach a faicly large (lOO'i- students )-intro- 
ductory course for undergraduates were interested in the potential 
of the service for providing additional reading list material. 
Students take an essay exam at the end of the course and are 
expected to integrate readings and lecture material in answer- 
ing questions* The existing reading lists are arranged top- 
ically* 

A major problem in identifying reading mattei -^or this 
course is that the existing printed indexes do not have a 
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retrieval voealntlary that adequately reflects the interests 
and intellectual focus of these instructors* On ine retrieval 
holds Bone promise in this respect because of its ability 
to conduct text searching of titles and abstracts for terns 
that the users judge to be relevant. 

These instructors prepared an information request <see 
sample form, Appendix F) that was developed into several search 
strategies and run against S6CIAL SCIENCE CITATION INDEX, 
PSYCHOLOGICAL ABSTRACTS, AND ERIC. The results, judged on 
the basis of the sample print/outs, were very pronising 
and identified a number of useful references. The service was 
judged potentially very valuable and the instructors reported 
that they would use It to add new material to their course 
reading lists. 

SAMPLE CLASS BIBLIOGRAPHY 2 

An instructor for a small (20-30 students) upper division 
undergraduate course was interested in a class bibliogreqphy 
he could provide for students as an aid in preparing an 
assigned term paper. His usual procedure is to ass i^ the 
topic, identify a few key references and have students locate 
any other pertinent material on 'Uieir own. 

From a written statement of the general paper topic, 
several search strategies were developed and run against 
PSYCHOLOGICAL ABSTRACTS, MEDLINE, CHEHCON, AND BIOSIS. the 
instructor found many of the retrieved citations to be 
hi^ly relevant and usefxtl for a student bibliography* He 
suggested some additional ways he might use the service for 
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developing reading lists and s^signiBents in a much larger 
IntrodudDry course he also teaches > e«g«( from a reconmended 
lie t of references containing abstractSt students would 
select 2-3 citations and prepare a brief (1-2 page) critique 
of methodology* conclusionst or other common element* 

SAMPLE CUSS BIBLIOGRAPHY 3 

The instructor of a small (5 students) graduate seminar 
permitted his students to prepare an Information request form 
for their own individual research pliers* The main purpose 
of this search wa*? to ejcplore the fe^ibiXity of preparing 
a search strategy for a range of individual information needs 
linked by their involveiiient with a common topic* Tn this 
particular instancot the search strategy proved highly 
manageable and the search conducted in less than 20 
minutes * 

The results were printed out in parts t 'Uie first part 
being literature review and summary type material* This 
was followed hy the material of prime value to each class 
member listed separately* Students and the instructor were 
positive in their evaluation of the bibliography and felt 
it would Srell^e worth a full trial* 
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B-1 

GSNERAL CLASS INFORMATION REPORT FORM 
(suggested format) 

Inetructions i The project coordinator wU.1 insure that the 
required inforaation for each class is obtainsd and entered 
m this form* 

1« Instructors 

2« Course title and nun;bert 

3* Department t 

4« Ntoftber of students enrolled! 

5* Copy of course catalog descriptions 

6« Teaching format (lectures f discussion groups f labs, etc)t 
?• Assignments and other requirements! 



8« Attachments! 

a* reading lists 
b« assignments 
o« teats 

9« Purpoae of bibliography 
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□PERflTIDMflL PROCEDURES RECORDING FORM 



(suggested 


format) 


TASK 


COMPLETED 
BY 


TIME SPENT 


CHARGES INCURRED 
(if any) 


PROBLEMS ENCDUNTERED 


cdhhents or 
suggested solutions 














































• 



[ 

Note: This recording form uould be completed for each class bibliography prepared. 

The form uould be initiated uith the pre search interview and be carried through the entire 
process. 



cn 
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C-1 

EVALUATION OF ON-LINE GENERATED BIBLIOGRAPHY 
TO BE COMPLETED BY STUDENTS 

(euggeeted format) 



1* Did this bibliogrs^hy help you to locate information 
that was useful to you? If not*plei«e indicate whyv 



2* How many items listed on this bibliography did you 
actually locataand read? 



3* Did you also consult the printed :.copy of the data 
base that was searched by con^uter? If yes* did you 
locate useful information that was not in the computer 
generated bibliogrcqphy? Please list those items* 



4* Was it valuable to you to have your own copy? 

5* Are there other Improvements you would suggest in this 
service? 



6* If students were required to purchase the bibliography 
rather than receive it for free* what would yott\ judge to be 
a reasonable price? 



7* Should this course continue to use this bibliography? 

8* Are there other classes you have had that you think 
could have made use of such a bibliography? 

9* Was the librarian's discussion of this bibliography and 
literature searching in general helpful to you? Please comment* 
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D-1 

EVALUATION OF ON-LINE G^ERATED BIBLIOGRAPHY 
XNTERVIEW QUESTIONS FOR INSTRUCTOR 

(suggested format) 



!• Did the ^Ibllogrs^hy meet your expectations? Please 
elaborate* 



2« How would you rate the value of the bibliography for 
students? 



3* Did the bibliography help you in any significant way 
in meeting your course objectives? 



What su^estions would you make for improving this 
bibliogrs^hic service? 



5* ^ What other ways could you see employing on line 
retrieval for courses? 



6« Was the bibliography valuable enough for this class 
to ask the university and/or the department snd/or students 
to pay iAie costs on a regular basis? If not for this 
class I do you think it would be so for another class? 
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EVALUATION OF ON-LINE GENERATED BIBLIOGRAPHY 
TO BE COMPLETED B7 SENIOR REFERENCE 
LIBRARIAN 



(suggested format) 



1. Compare the statement of infoxmation need prepared by 
the user and the search strategy prepared by the 
librarian? Does the search strategy adequately reflect 
the information need? Would you suggest any improvements? 



2. Were the appropriate data bases searched? Comment. 



3. Examine the printed versions of the data bases searched. 
Were there citations present in the printed versions 
that were relevant to the information need but th9t were 
not retrieved by the on-line search? Comraent. 



ERIC ^ ^ 



APPENDIX F 



ERIC 



68 



DESCRIPTION OF TOPIC 

Please describe in yovir ovm words and as precisely as 
possible the topic or topics in vAiich you are interested. 
It is especially helpful to indicate a-iy techniques, groups, 
timB periods, geographic areas or other limiting factors 
that are of particular interest > 
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The retrieval sysi;em uib are using match tha words that descrihG 
your topic with thu words that dsscHbe the ref 3renc;G9. The value 
of the search rearjlts are 9r£>at;ly at'fected by haw sdequately ths 
uiords utJGd In your request reflec?; your hssit: area of interest. 
Please list bslonj any Index tenns^ uords^ or phrases and their syn^ 
otiyms that you yould une as criteria For asloctlng references if 
you ujere doing this search manually ^ Pe sure to note if any of 
these uords have special msaning^ In your searcn or ha»ie meanings 
that should be excluded ^ 

UDf^OS/rEnrB/PHRASES SYF^DAIVMS OR CLnSELY MEaWIWGS TO 

^EL^TEO TERr-S BE EXCLUDED 
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1* Do you v/ish to receive references to documents vjritten ini 
^English any language othe r 

(specify) 

2, Pleass list any authors or organisations v/hose work is alv;ays 

of interest to you in connection v/ith this topic* (full name if knowr 



3» Please list the joux^nals you think are most likely to contain 
articles pertinent to your topic. 



^» V/hich of the following types of references do yoii v;ish to rpceive? 
{may not he possible to specify for all data bases) 

patents technical reports biographies 

dissertations books_^ ^ letters 

conference journal article s editorials 

proceedings book reviews review articles 

5* Would it be more- useful to you to have: 

A very broad search tliat would identify as many potentially 

relevaiit articles, or other items as possible* even 
though mcst would probably not be pertjjaent to your 

topics 

or 

.. A narror/er search that v;ould yield fewer references ^ most 
of i^hich vfould probably be pertinent i even if sonje 
oliiher relevant iter^;S vjere missed* 

6. Please list the publioation years you would like to search, in 
their order of value to you* (Earliest searchable year will 
vary ai^iong data Mses) 

Fost valuable " ^Least valuable 

7* \Wtat is the maximum number cf references you v;ant to receive 



t_ 3^ If possiblOo wovld you lil:o your oxbput arranged in a particular 
^ vrayt e«g* by author? by title* by date* by subject aspect^ etc? 
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o Please list cne or two recent references in yotir area of interest 
that you have foim.d useful c Tiiia helps us determine v/hether the 
search strategy is locaciiig xteras knoipm to be relevant to your 
topic* 



0. If the vfovk of a particular author is of special importance 
to your topic and you would li!\e to find references which have 
cited that author»s v;ork, please list the author, the title 
of his work, the journal title if it appeared in a periodical* 
and the yesr of publication. 
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